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Packet 
Type 


Full Name 


Address Space 


Description 




I/O 


IA 1 O 


r\cdu I uoi idle; 


Y 




Kequests reaa-omy copy ot cacne line 






Y 




Requests writable copy of cache line 




Keaa i owntebacK 


Y | 




Requests to receive writable copy of cache line 
and send cache line to memory 


DC 

Kb 


KeadStream 


Y 




Request read-once copy of cache line 


\ A /o 

ws 


WriteStream 


Y 




Request to write entire cache line and send to 
memory 


WB 


WnteBack 


Y 




Request to send cache line from owning device 
to memory, device does not keep copy 


Vv DO 


V VI llcDdurxOildltrQ 


Y 




Request to send cache line from owning device 
to memory, device keeps read-only copy 


RIO 


ReadlO 




Y 


Request to read 10 locations 


WIO 


WritelO 




Y 


Request to write 10 locations 


INT 


Interrupt 






Sends an interrupt, target is specified by 
address 
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Transaction Type 


Initiator Receives 


Initiator Sends 


RTS 


DATA 




RTO 


DATA 
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DATA & PRN 


DATA 


RS 


DATA 
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Transaction Type 


Initiator Receives 


Initiator Sends 


RIO 


DATA 




WIO 


PRN 


DATA 


INT 


PRN or NACK 


DATA or Nothing 



Fig. 9 



Access Rights Symbol 


Access Rights Name 


Description 


Data Present? 


W 


Write 


Read and Write 


Yes 


A 


All-Write 


Write-only, must write entire cache line 


Yes (or ACK) 


R 


Read 


Read-only 


Yes 


T 


Transient-Read 


Read-only, read can be reordered 


Yes 


1 


Invalid 


No access rights 


Yes or No 



Fig. 10A 



Ownership Status Symbol 


Ownership Status Name 


Description 


Data Present? 


0 


Owner 


Owns cache line 


Yes or No 


N 


Not Owner 


Does not own cache line 


Yes or No 



Fig. 10B 
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Transaction Type 
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RTO 
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WS 


Memory 


WB 


Memory (or Previous Owner) 


WBS 


Memory (or Previous Owner) 
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StateDescription 


WOfh 


Waitinn for WAIT and APK^ for \r\ra\ \A/Q hoc t.iri+o ^.--j l,;^ ~~ 
vvaiuny iui vvmi i diiu MUr\ lUi lUCdl Wo, flaS WnI6 3CC6SS 3110 OWnBrSflip 


WO 


Stahlp ^tatP with \Juritp ar*f*OCC anH mn/norehir* 
uiauic oiaic wiui wine aULcoo dllU UWnciSnip 


ROfh 


Waitinn, for WAIT anrl ACK fnr Inral \A/Q hac nori n^orp 

vvaiuiiy iui vvaai i aiiu r\V-/r\ iui IUL»dl WO, MaS redd 3CC6SS 3110 0WnerSmP 


ROe 


Waitinn fnr RATA fnr lor*al RTO hoe m^H n^nrr » n/ j l.- ~" 

wdiuny iui ut\ \ m iui luudi r\ i u, nas reaa acc6ss ano ownership 


ROdp 


Waitinn fnr IM\/ anrl HAT A for lnr»ol DTH Woo m^<4 -...^^^u:-* ^ ~ 

wdiuiiy iui iiNv dnu ua i a ior local k i u, nas reao access and ownership 


RDri 

1 \vJU 


waning ior iinv ior local r\ i u, nas reaa access and ownership 




waning ior wai i ana ua i a Tor local RTu, has read access and ownership 


RO 


Stable state with read access and ownership 


lOe 


Waiting for DATA for local RTO, has no access rights, has ownership 


lOde 


Waiting for INV and DATA for local RTO, has no access rights, has ownership 


lOd 


Waiting for INV for local RTO, has no access rights, has ownership 


WNj 


Able to send DATA/NACK for local WB/WBS, has write access and no ownership 


WNi 


Able to send DATA for local RTWB, write access, no ownership 


WNh 


Waiting for ACK for local WS, has write access, no ownership ~^ 


WNe ! 


Waiting for WAIT for local RTO, has write access, no ownership 


WN 


Stable state with write access, no ownership (caused by foreign transaction that took ownership, but 
for which no copyback has yet been performed) 


A Mi 
MINI 


ADie to sena ua I A tor local WS after performing write to entire cache line, no ownership 


dm: 


Able to send DATA/NACK for local WB/WBS, has read access and no ownership 


□ ML. f 


Waiting tor ACK for local WS, has read access, no ownership 


RNg 


Waiting for INV for local WS, has read access, no ownership 


RNe 


Waiting for DATA for local RTO, has read access, no ownership 


RNde 


Waiting for INV and DATA for local RTO, has read access, no ownership 


RNd 


Waiting for INV for local RTO, has read access, no ownership 


RNce 


Waiting for WAIT and DATA for local RTO, has read access, no ownership 


RNcd 


Waiting for WAIT and INV for local RTO, has read access, no ownership 


RN 


Stable state with read access, no ownership 


TN 


Performing read(s), which may be reordered, for local RTS or RS, no ownership 


tNk 


Waiting for RTO, RTWB, WS, WB or WBS after receiving an ERR or ERRL No access rights, no 
ownersnip 


I Ki: 
INJ 


ADie to sena ua i a/imack for local WB/WBS, has no access and no ownership 


INh 


Waitina for ACK for Inral nr fnr RATA fnr Innal DTVWD hoe? nr\ o#»<* A ~#« j.Li. „^ ^, i • 

waiuny iui iui luodi wo or ior ua i a ior iocai k i wo, nas no access ngnts, no ownersnip 


INg 


Waiting for INV for local WS or for INV for local RTWB, has no access rights, no ownership 


INe 


Waiting for DATA for local RTO, has no access rights, no ownership 


INde 


Waiting for INV and DATA for local RTO, has no access rights, no ownership 


INd 


Waiting for INV for local RTO, has no access rights, no ownership 


INce 


Waiting for WAIT and DATA for local RTO, has no access rights, no ownership 


INcd 


Waiting for WAIT and INV for local RTO, has no access rights, no ownership 


INa 


Waiting for DATA for local RTS, DATA may grant read access, has no access rights, no ownership 


IN 


Stable state with no access rights, no ownership 



Fig. 15A 
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Action 
Code 

wwuw 


Meaning 


Comments 


/a 


Commit to send an ACK packet as a 
copyback by appending an entry for the 
received foreign packet in a copyback list. Set 
copy tag to I. 


ACK packet may be sent from any state that allows 
copyback packets to be sent. It must be sent within a 
finite time of first entering such a state, regardless of 
what other packets have been received. 


d 


Commit to send DATA and/or ACK packets 
for all outstanding copybacks for this cache 
line. Next, set copy tag to W. Then, perform 
state transition based on current state & 
local packet being received 


If sending copybacks changes the state from a state 
X to a state Y, the local packet being received will be 
received in state Y (and as a result, the entry for state 
Y in the table must be consulted to determine the 
state transition caused by receiving the local packet). 


Id 


Commit to send DATA packet for local RTWB, 
WS, WB, or WBS transaction. DATA packet is 
sent in response to receiving a PRN packet 
for this transaction. 


DATA packet may not be sent until a PRN packet is 
received. It must be sent within finite time of receiving 
the PRN packet & having entered a state that permits 
the packet to be sent, regardless of what other 
jjduivcio ndve ueen received. 


e/ 


Olpar mitetflnriinn f*nn\/har*!r rnmmitmontc fAr 
wicai uuioiai mil lAjpyuaOfv UUillflllUIicl lib lOi 

this line by removing them from the copyback 
list. Do not send DATA or ACK packets for 
entries that were on the copyback list. Next, 
perform state transition based on current state 


The action code is used in response to receiving an 
ERR or ERRL packet. If an ERR packet was 
received in place of a PR or PRACK packet, or if an 
ERRL packet was received in place of a DATAP 
packet, a DATA packet may be sent to the error 
device. 


/i 


Commit to send a DATA packet as a 
copyback by appending an entry for the 
received foreign packet in the copyback list. 
Set copy tag to I. 


DATA packet may be sent from any state that allows 
copyback packets to be sent. It must be sent within 
finite time of first entering such a state, regardless of 
what other packets have been received. 


/i 


Set write taa to I 




/n 


Commit to send NACK packet for local WB or 
WSB transaction & set write tag to W. NACK 
packet is sent in response to receiving a PRN 
packet for this transaction. 


NACK packet may be sent at any time after receiving 
the PRN packet. It must be sent within finite time of 
receiving the PRN packet, regardless of what other 
packets have been received. 


It 


Commit to send DATA packet as a copyback 
by appending an entry for the received foreign 
packet in the copyback list. If copy tag is W, 
set copy tag to R. 


DATA packet may be sent from any state that allows 
copyback packets to be sent. It must be sent within 
finite time of first entering such a state, regardless of 
what other packets have been received. 


Is 


Set write tag to R. 




/w 


Commit to send DATA packet as a copyback 
by appending an entry for the received foreign 
packet in the copyback list. 


DATA packet may be sent from any state that allows 
copyback packets to be sent. It must be sent within 
finite time of first entering such a state, regardless of 1 
what other packets have been received. 


/y 


If copy tag is R, set copy to 1 . 


Used to record invalidating transactions while a 
copyback for a foreign memory remap is pending. 


lz 


If write tag is R, set write to 1. 


Used to record invalidating transactions while a local 
WBS transaction is pending. 



Fig. 15B 
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Interface 
148A 



Data Network 
152A 



140B 



Address Network 
150B 



Processing 
Subsystem 
142AB 
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Memory 
Subsystem 
144BB 



I/O 
Subsystem 
146B 
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gTag 


Description 


gM 


The maximum access right within the node is Write Access 


gs 


The maximum access right within the node is Read Access. 
No client device in the node can have Write Access. 


g« 


The maximum access right within the node is Invalid Access. 
No client device in the node can have Read or Write Access. 
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Packet 
Type 


Full Name 


Address Space 


Description 


Cacheable 


I/O 


PRTS 


Proxy RTS 


v 

T 




Request from an interface in a gS or gi node in 
response to a RTS request from another node 


PRTSM 


Proxy RTS Modified 


V 
Y 




Request from an interface in a gM node in 
response to a RTS request from another node 


PRTOM 


Proxy RTO Modified 


Y 




Request from an interface in a gM node in 
response to a RTO request from another node 


PRTO 


Prnxv RpaHTnDwn 


Y 




Kequesi irom an interlace in response to a 
RTO request from another node 


PU 


Prnyv 1 InnraHp 


Y 




Request from an interface asking memory to 
supply data for an outstanding RTO 


pnu 


PrnvA/r^atal InnroHo 

r lUAyudidupgrdue 


Y 




Request from an interface asking memory to 
update gTag to gM; interface supplies data for 
an outstanding RTO 


PRSM 


Proxy ReadStream 
Modified 


Y 




Request from an interface in a gM node in 
resoonse to RS renue^t fmm annthpr nnHo 

\ y^^j^ssji iwV« IW l\w ICVjUCgl II Will Gil IVJil ICI 1 |\JUC 


PIM 


Proxy In valid ate 
Modified 


Y 




Request from an interface in a gM node to 
invalidate data in caches and mernnrv 


PI 


Proxylnvalidate 


Y 




Request from an interface in a gS or gl node to 
invalidate data in caches and memory 


PMR 


ProxyMemoryRead 


Y 




Request from an interface to memory to read 
coherency state(s) and data or meta-data 


PMW 


ProxyMemoryWrite 


Y 




Request from an interface to memory to write 
coherency state(s) and data or meta-data 


Fig. 22 


Packet 
Type 


Full Name 


Description 


DATAM 


Data-Meta 


Data packet containing data and coherence state information 


DATAN 


Data-NoPull 


Data packet sent in response to PRTSM indicating no PRN will be 
coming 


REP 


Report 


Report from memory to an interface indicating a transaction to be 
handled by the interface 



Fig. 23 
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Subtransaction 


Preexisting 

Global Access State 


New Global Access State 


PRTSM 


Modified 


Shared 


PRTOM 


Modified 


Invalid 


PRTO 


Shared, Invalid 


Invalid 


PU 


Shared 


Modified 


PDU 


Shared, Invalid, Modified 


Modified 


PRSM 


Modified 


Unchanged 


PIM 


Modified 


Invalid j 


PI 


Shared, Invalid 


Invalid I 


PMR 


Shared, Invalid, Modified 


Unchanged 


PMW 


Shared, Invalid, Modified 


Equal to new global access state 
specified in DATAM packet 
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Slave Node 140S 
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Requesting Node 14QR 
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Requesting Node 140R 
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Home Node 140H 




Requesting Node 140R 
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Home Node 140H 




Requesting Node 140R 
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Response 
Info 


Coherence 
State 


Home Memory Subsystem Action 


No 


gM 


uu iviuue— miiow owning device to respond. 
PTP Mode- Forward response to owning 
device 


No 


gs 


Send REP packet to interface if write access 
requested 


No 


gi 


Send REP packet to interface 


Yes 


gM 


Respond with copy of the requested 
coherency unit 



Fig. 35 



Response 
Info 


Memory Subsystem's Action 


mN 


Does not respond with copy of 
coherency unit because a cache within 
the node owns the coherency unit 


mR 


Does respond because memory is the 
owner 


mS 


Does respond to requests for shared 
access because memory has shared 
copy and no active device has 
ownership; does not respond to 
requests for write access 


ml 


Does not respond because memory's 
copy is invalid 



Fig. 36 
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Slave Node 140S 




Requesting/Home Node 140H 
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I 

Send PRTOM, PRTSM, PIM t or PRSM 
specifying the coherency unit 
500 



Respond = false 
502 



Current record = oldest record in OTQ 
specifying the coherency unit 
504 




Respond = 

False: Receive data packet 
from active device in 
response to packet sent at 
500. Send received data in 
coherency message 

True: Send data from buffer 
in coherency message 

512 



Current record = 

RTO: Send data packet using data from 
buffer if respond = true & set respond = 
false 

RS, RTS: Send data packet using data 
from buffer if respond = true 

WB, WBS: Send PRN packet. Set 
respond = true if responsive DATA 
packet received & store received data in 
buffer 

WS, RTWB: If respond = false, send 
PRN & set respond = true & store 
received data in buffer. If respond = true, 
send PRACK or DATAP 

508 



Current record = next oldest record in 
OTQ specifying the coherency unit 
510 



Fig. 37A 



REPLACEMENT SHEET 

41/43 
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Packet 
Type 


Full Name 


Description 


RWB 


Remote WB 


Request sent from an active device in a multi-node system 
to an interface in order to initiate a WB transaction ! 


RWBS 


Remote WBS 


Request sent from an active device in a multi-node system 
to an interface in order to initiate a WBS transaction 


RWS 


Remote WS 


Request sent from an active device in a multi-node system 
to an interface in order to initiate a WS transaction 



Fig. 39 
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